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BACKGROUND 

20 Field of the Invention 

[0001] The present invention relates to the design of virtual machines that 
execute platform-independent applications within computer systems. More 
specificelly, the present invention relates to a method and an apparatus for 
reducing the overhead involved in executing native code methods from a 

25 platform-independent application running on a virtual machine. 



Related Art 

[0002] The rapid proliferation of the Internet has in part been fueled by the 
development of computer languages, such as the JAVA™ programming language 
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distributed by Sun Microsystems, Inc. of Santa Clara, California. The Java 
programming language allows an application to be compiled into a module 
containing platform-independent byte codes, which can be distributed across a 
network of many different computer systems. Any computer system possessing a 
5 corresponding platform-independent virtual machine, such as the Java Virtual 
Machine, is then able to execute the byte codes. In this way, a single form of the 
application can be easily distributed to and executed by a large number of 
different computing platforms. 

[0003] In some cases, it is useful for a platform-independent application to 
10 be able to access compiled code written in other languages. To this end, the Java 
Virtual Machine (JVM) provides the Java Native Interface (JM), which enables 
Java applications to access native methods. Through such native methods, Java 
applications are able to perform low-level system operations, such as I/O 
operations. 

15 [0004] Furthermore, JNI provides an interface through which native code 

can manipulate heap objects within the JVM in a platform-independent way. For 
example, native code may call the "GetObjectField" JNI function to fetch a value 
of a field in a Java heap object. In doing so, the native code does not have know 
how the Java object is represented in a specific JVM. 

20 [0005] Although the JNI facilitates portability of native code across JVM 

implementations (on a given platform), every call to a native code method through 
the JNI involves time-consuming indirect calls and associated indirect references. 
Furthermore, every access to a heap object from the native code method also 
involves time-consuming indirect calls and associated indirect references. These 

25 indirect calls and associated indirect references can introduce a significant amount 
of overhead, especially for calls to methods that perform very little computational 
work. 
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[0006] Hence, what is needed is a method and an apparatus that reduces 
the overhead involved in calling a native code method from a platform- 
independent application. 

SUMMARY 

[0007] One embodiment of the present invention provides a system that 
reduces the overhead involved in executing a native code method in an application 
running on a virtual machine. During operation, the system selects a call to a 
native code method to be optimized within the virtual machine. The system then 
decompiles at least part of the native code method into an intermediate 
representation. The system also obtains an intermediate representation associated 
with the application running on the virtual machine. Next, the system combines 
the intermediate representation for the native code method with the intermediate 
representation associated with the application running on the virtual machine to 
form a combined intermediate representation. The system then generates native 
code from the combined intermediate representation, wherein the native code 
generation process optimizes interactions between the application miming on the 
virtual machine and the native code method. 

[0008] In a variation on this embodiment, selecting the call to the native 
code method involves selecting the call based upon the execution frequency of the 
call, and the overhead involved in performing the call to the native code method 
as compared against the amount of work performed by the native code method. 

[0009] In a variation on this embodiment, optimizing interactions between 
the application running on the virtual machine and the native code method 
involves optimizing calls to the native code method by the application. 

[0010] In a variation on this embodiment, optimizing interactions between 
the application running on the virtual machine and the native code method 
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involves optimizing callbacks by the native code method into the virtual machine. 
For example, the system can optimize callbacks that access heap objects within 
the virtual machine. 

[0011] In a variation on this embodiment, obtaining the intermediate 
5 representation associated with the application running on the virtual machine 
involves recompiling a corresponding portion of the application. 

[0012] In a variation on this embodiment, obtaining the intermediate 
representation associated with the application running on the virtual machine 
involves accessing a previously generated intermediate representation associated 
10 with the application running on the virtual machine. 

[0013] In a variation on this embodiment, the virtual machine is a Java 
Virtual Machine (JVM) and combining the intermediate representation for the 
native code method with the intermediate representation associated with the 
application running on the virtual machine involves integrating calls provided by 
1 5 the Java Native Interface ( JNI) into the native code method. 

[0014] In a variation on this embodiment, prior to decompiling the native 
code method, the method further comprises setting up a context for the 
decompilation by: determining a signature of the call to the native code method; 
and determining a mapping from arguments of the call to corresponding locations 
20 in a native application binary interface (ABI). 

BRIEF DESCRIPTION OF THE FIGURES 
[0015] FIG. 1 illustrates a virtual machine in accordance with an 
embodiment of the present invention. 
25 FIG. 2 presents a flow chart illustrating the process of optimizing a call to a native 
code method from an application running on a virtual machine in accordance with 
an embodiment of the present invention. 
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DETAILED DESCRIPTION 
[0016] The following description is presented to enable any person skilled 
in the art to make and use the invention, and is provided in the context of a parti- 
cular application and its requirements. Various modifications to the disclosed 

5 embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 

10 disclosed herein. 

[0017] The data structures and code described in this detailed description 
are typically stored on a computer readable storage medium, which may be any 
device or medium that can store code and/or data for use by a computer system. 
This includes, but is not limited to, magnetic and optical storage devices such as 

15 disk drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs 
or digital video discs), and computer instruction signals embodied in a 
transmission medium (with or without a carrier wave upon which the signals are 
modulated). For example, the transmission medium may include a 
communications network, such as the Internet. 

20 

Virtual Machine 

[0018] FIG. 1 illustrates a virtual machine 102 within a computing device 
100 in accordance with an embodiment of the present invention. Computing 
device 100 can include any type of computing device or system including, but not 
25 limited to, a mainframe computer system, a server computer system, a personal 
computer system, a workstation, a laptop computer system, a pocket-sized 
computer system, a personal organizer or a device controller. Computing device 
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100 can also include a computing device that is embedded within another device, 
such as a pager, a cellular telephone, a television, an automobile, or an appliance. 

[0019] Computing device 100 includes virtual machine 102. Virtual 
machine 102 can generally include any type of virtual machine that is capable of 
5 executing platform-independent code, such as the JAVA VIRTUAL 

MACHINE™ developed by SUN Microsystems, Inc. of Santa Clara, California. 
(Sun, Sun Microsystems, Java and Java Virtual Machine are trademarks or 
registered trademarks of Sun Microsystems, Inc. in the United States and other 
countries.) 

10 [0020] Virtual machine 102 can execute a platform-independent 

application 104. Platform-independent application 104 can include any type of 
application that can execute on virtual machine 102. In one embodiment of the 
present invention, virtual machine 102 is a Java virtual machine (JVM) and 
platform-independent application 104 is made up of platform-independent Java 

15 bytecodes (as well as native methods). 

[0021] Virtual machine 102 also includes object heap 106 for storing 
objects that are manipulated by platform-independent applications, such as 
application 104, which execute on virtual machine 102. 

[0022] Virtual machine 102 additionally provides a native interface 1 10, 

20 such as the Java Native Interface (JNT), which facilitates calls to methods in native 
code 1 12 from applications running on virtual machine 102. Note that computing 
device 100 provides a number of native code methods for performing low-level 
system functions, such as I/O operations. (These native code methods can be 
compiled from another programming language, such as the C programming 

25 language.) 

[0023] As is illustrated in FIG. 1, native interface 110 allows application 
104 to call a method from within native code 1 12. In particular, native interface 
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110 facilitates a native method call 1 14 from application 104, and a native method 
return 1 15 to application 104. Native interface 110 also allows native code 1 12 to 
perform a callback 1 16 to virtual machine 102. As illustrated in FIG. 1, this 
callback 1 16 can, for example, access an object 108 within object heap 106. 
5 [0024] Virtual machine 102 also includes a native call optimizer 1 18, 

which optimizes calls the native code methods and associated callbacks to virtual 
machine 102 as is discussed in more detail below with reference to FIG. 1. 

Process of Optimizing a Call to a Native Code Method 

10 [0025] FIG. 2 presents a flow chart illustrating the process of optimizing a 

call to a native code method from an application running on a virtual machine in 
accordance with an embodiment of the present invention. The process starts when 
the system selects a call to a native code method to be optimized (step 202). This 
selection process can involve examining the execution frequency of the call. 

15 (Note that there is little benefit in optimizing calls that are made infrequently.) 
This execution frequency can be obtained, for example, by instrumenting the 
boundary of a method to determine how often to the method is invoked from a 
specific call site. 

[0026] The selection process can also involve considering the overhead 
20 involved in performing the call to the native code method as compared against the 
amount of work performed by the native code method. For native methods that 
perform a significant amount of computational work, the overhead involved in 
performing the call is not significant when compared against the total time spent 
executing the native method. Calls to such computationally intensive native 
25 methods receive little benefit from optimization. On the other hand, calls to 
native methods that perform very little computational work can benefit greatly 
from optimization. 
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[0027] Once a call to a native method is selected, the system sets up a 
context for decompilation (step 204). This can involve determining a signature of 
the call, and determining a mapping from arguments of the call to corresponding 
locations in a native application binary interface (ABI). 
5 [00281 Next, the system decompiles the selected method into an 

intermediate representation (IR) (step 206). Note that the term "intermediate 
representation" as used in this specification can include any intermediate 
representation of code between the original source code and the final binary 
executatle code for the application. For example, the intermediate representation 
10 can include, but is not limited to, modified source code, platform-independent 
byte codes, assembly code, an intermediate representation for computational 
operations used within a compiler, or binary code that is not in final executable 
form. 

[0029] The system also obtains an intermediate representation, associated 
15 with the application running on the virtual machine, which performs calls to 

native code methods and callbacks into virtual machine 102 (step 208). This can 
involve recompiling a corresponding portion of application 104 to obtain the 
intermediate representation, or alternatively, accessing a previously generated 
intermediate representation associated with application 104 running on the virtual 
20 machine 102. 

[0030] Next, the system integrates IR for the native code method into the 
IR associated with application 104 running on virtual machine 102 (step 210). 
This can involve inlining smaller native code methods into call site in application 
104, inlining or smaller implementations of native interface methods to perform 
25 callbacks into native code 1 12. Note that inlining generally does not make sense 
for larger methods. 



8 

Attorney Docket No. SUN-P9042-SPL Inventors: Wright et al. 

ARP E:\SUN MICROSYSTEMS\SUN-P9042-SPL\SUN-P9402-SPLAPPLICATON.DOC 



[0031] Finally, the system generates native code from the integrated JR 
(step 212). During this code generation process, standard compiler optimization 
techniques are performed to eliminate unnecessary indirect calls and indirect 
references associated with calls to native methods and related callbacks. 
5 [0032] Note during this optimization process, more information is 

available than when a general dynamic re-optimizer is applied to the same 
compiled code. For example, the above-described process would know that 
environment pointers refer only to read-only structures. This additional 
information can be used to improve the optimization process. 

10 [0033] Also note that as with Java compilation the above-described 

optimization process can be performed adaptively or just-in-time, based upon 
which calls and/or callbacks are heavily used. 

[0034] The foregoing descriptions of embodiments of the present 
invention have been presented for purposes of illustration and description only. 

15 They are not intended to be exhaustive or to limit the present invention to the 

forms disclosed. Accordingly, many modifications and variations will be apparent 
to practitioners skilled in the art. Additionally, the above disclosure is not 
intended to limit the present invention. The scope of the present invention is 
defined by the appended claims. 
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